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I. 


INTRODUCTION 


A.  MOTIVATION 

The  world  of  digital  imagery  has  seen  significant  growth  in  recent  years,  both  in 
the  technology  of  imagery  acquisition  and  in  the  technology  and  the  techniques  of 
imagery  progressing  and  analysis.  During  this  time  the  face  of  the  military  battlefield  has 
also  seen  significant  changes.  The  modem  enemy  is  no  longer  predictable  both  in  his 
identity  or  his  methods.  The  enemies  the  military  face  today  do  not  advertise  their 
presence  nor  do  they  conduct  overt  attacks.  Their  greatest  weapon  is  their  expert  use  of 
the  murky  shadows  from  which  they  strike.  Concealment  and  deception  is  their  primary 
means  of  warfare.  In  response  to  this  modem  threat  the  military  has  been  aggressively 
pursuing  various  methods  to  deprive  the  enemy  of  his  camouflage,  concealment  and 
deception.  The  mission  area  of  Counter-Camouflage,  Concealment  and  Deception 
(Counter-CC&D)  is  currently  receiving  considerable  attention  by  the  military  and  the 
intelligence  community  as  they  stmggle  to  use  modem  technology  to  counter  the  oldest 
tricks  in  the  book  of  warfare.  Unfortunately,  many  of  the  technologies  that  are  being 
pursued  are  too  bulky,  too  costly  or  plagued  with  low  detection  rates  and  high  false- 
alarms.  Some  are  based  on  immature  technology  making  them  unlikely  to  produce  a 
useful  product  to  meet  the  warfighter  needs  in  the  immediate  future. 

A  low  cost  commercially  available  camera  may  assist  the  warfighter  in  this 
counter-CC&D  role.  This  camera  utilizes  the  unique  triple-well  FOVEON  focal  plane. 
The  FOVEON  design  is  a  multi-layer  Complementary  Metal  Oxide  Semiconductor 
(CMOS)  focal  plane  that  allows  the  acquisition  of  spectral  imagery  in  the  near  ultra¬ 
violet  (NUV),  visible  and  the  near  infrared  (NIR).  The  exploitation  of  these  images  with 
commercially  available  imagery  analysis  software  holds  the  potential  to  detect  man-made 
objects  hiding  in  natural  surroundings  by  analyzing  the  reflectance  and  absorption 
characteristics  of  the  objects  in  the  digital  scene. 
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B.  OBJECTIVE  OF  RESEARCH 

The  objective  of  the  research  is  to  explore  commercially  available,  low  cost  and 
highly  portable  imagery  exploitation  systems  to  be  utilized  in  the  Counter-CC&D 
military  mission  area.  The  research  focuses  on  the  unique  multispectral  detecting 
capability  of  the  FOVEON  image  sensor.  The  FOVEON  sensor  is  exploited  to  create  a 
low  cost,  lightweight  Counter-CC&D  tool  that  can  be  used  by  the  military  in  the  field. 
The  study  continues  the  work  began  in  the  December,  2004  Naval  Postgraduate  School 
thesis  by  Major  Cheak,  entitled  Detecting  Near-UV  and  Near-IR  Wavelengths  with  the 
FOVEON  Image  Sensor. 

In  the  work  that  follows,  the  FOVEON  image  sensor  was  characterized  in  the 
laboratory  then  the  imagery  system  was  assembled.  The  system  consisted  of  the  image 
sensor,  a  portable  laptop  computer,  a  frame-grabber,  and  a  digital  imagery  progressing 
and  analysis  software  tool.  The  imagery  analysis  platform  is  then  used  to  acquire  and 
study  imagery  of  a  Counter-CC&D  nature  with  the  goal  of  creating  a  database  of  imagery 
processing  techniques  to  be  utilized  by  the  military  in  the  field. 


2 


II.  BACKGROUND 


A.  OVERVIEW  OF  CURRENT  TECHNOLOGIES  BEING  USED  IN 

COUNTER-CC&D 

Counter-CC&D  is  the  ability  to  detect  obscured  targets  in  foliage,  under 
camouflage,  in  shallow  hides,  or  those  utilizing  deception  techniques.  In  this  military 
mission  area  the  current  standard  techniques  in  use  is  long  wavelength  synthetic  aperture 
radar  (SAR)  to  penetrate  foliage  and  other  materials.  Foliage  and  most  covering  materials 
are  transparent  to  long  electromagnetic  wavelengths.  Research  and  technical 
demonstrations  are  also  being  conducted  to  demonstrate  the  utility  of  hyperspectral 
imagery  in  a  Counter-CC&D  role.  The  use  of  Laser  Radar  (LADAR)  is  also  being 
studied  as  a  means  of  countering  CC&D.  A  brief  overview  of  these  areas  is  presented 
below. 

1.  Foliage-penetrating  (FOPEN)  Radar 

Foliage-penetrating  (FOPEN)  radar  operating  in  the  VHF  or  UHF  frequency 
ranges  are  being  utilize  on  UAVs  such  as  Global  Hawk  and  on  manned  surveillance 
aircraft  like  the  Army  RC-12.  Long  wavelength  electro-magnetic  energy  penetrates 
vegetation  and  lightweight  covering  with  little  attenuation.  FOPEN  SAR  has  been  in  use 
by  the  military  for  several  years  and  it  is  a  proven  technology  for  detecting  targets  at  long 
range  in  all  weather  and  lighting  condition. 

Moyer  [1]  noted  that  the  same  physical  mechanism  that  gives  FOPEN  SAR  its 
penetrating  power  is  also  the  reason  for  its  limitations,  its  use  of  long  wavelength 
energy. 1  The  resolution  of  FOPEN  SAR  imagery  is  poor  due  to  the  inverse  relationship 
between  resolution  and  wavelength.  Poor  resolution  and  the  large  amounts  of  surface 
clutter  reflection  leads  to  missed  targets  and  a  very  high  false-alarm  rate.  Also,  it  is  not 
readily  portable  due  to  the  bulky  radar  support  gear  that  is  required.  FOPEN  SAR  is 
further  challenged  by  the  crowded  VHF  and  UHF  spectrum  in  which  it  operates.  FOPEN 
SAR  suffers  from  radio  frequency  interference  from  radio  stations,  TV  stations, 
commercial  and  military  communications. 

1  Lee  Moyer,  Defense  Advanced  Research  Projects  Agency  (DARPA)  Special  Project  Office  CC&D 
Program  Manager’s  speech 
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2.  Hyperspectral  Imagery  (HSI) 

As  outlined  in  Pabich  [2],  hyperspectral  imagery  (HSI)  holds  potential  for  military 
application  in  the  area  of  Counter-CC&D.  By  analyzing  the  multiple  spectrum  bands  of 
HSI  it  is  possible  to  detect  concealed  targets  by  keying  on  their  reflectance  differences  at 
non-visual  wavelengths.  This  property  gives  HSI  the  ability  to  distinguish  real  targets 
from  decoy  thereby  preventing  the  waste  of  expensive  precision  munitions  on  decoys.  It 
can  also  detect  targets  hiding  in  backgrounds  and/or  under  camouflage. 

DARPA,  the  Army,  the  Navy,  and  the  Air  Force  all  have  ongoing  HSI  research 
projects  utilizing  both  airborne  and  space  based  systems.  HSI  appears  to  offer  excellent 
future  potential  for  the  military,  but  as  was  pointed  out  in  Pabich  [2]  given  the  newness  of 
this  technology  it  will  take  some  time  before  the  Department  of  Defense  (DoD)  works 
through  the  numerous  administrative  and  logistics  hurdles  in  the  way  of  putting  usable 
HSI  technology  in  the  hands  of  the  warfighter. 


3.  Laser  Radar  (LADAR) 

DARPA  has  been  conducting  research  into  the  use  of  LADAR  to  detect  concealed 
targets  in  foliage  or  under  camouflage  as  discussed  in  Hauge  [3],  Using  short  pulse  (2 
nanosecond)  LADAR,  the  capability  of  identifying  tanks  under  a  forest  canopy  has  been 
demonstrated.  The  forest  canopy  reflects  most  of  the  transmitted  LADAR  energy  except 
that  portion  which  passes  through  the  gaps  and  is  reflected  by  the  target.  The  LADAR 
returns  are  in  the  form  of  range  to  the  target,  which  lends  itself  to  the  creation  of  3-D 
images,  which  aids  in  the  target  recognition  process. 

To  make  LADAR  a  useful  Counter-CC&D  technology  for  the  warfighter  in  the 
field  the  size  and  power  requirements  of  the  laser  must  be  decreased.  Also  due  to  high 
atmospheric  attenuation  that  occurs  in  the  LADAR  operating  frequency  band  the 
operational  range  of  the  system  is  currently  limited.  DARPA  is  working  on  these  and 
others  limitations  in  an  attempt  to  make  LADAR  a  useful  military  counter-CC&D  tool  in 
the  near  future. 
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B.  OVERVIEW  OF  THE  FOVEON  IMAGE  SENOR 

The  operation  and  characteristics  of  the  FOVEON  image  sensor  has  been  covered 
thoroughly  in  Cheak  [4];  a  brief  overview  is  presented  here.  The  FOVEON  image  sensor 
differs  from  traditional  photodetector  in  its  construction  and  that  physical  difference  is 
the  source  of  its  unique  spectrum  properties.  Unlike  traditional  semiconductor 
photodetectors  that  only  detect  one  primary  color  per  detector  and  then  simulate  the  other 
two  primary  colors  by  means  of  interpolation  and  integration,  the  FOVEON  sensor 
detects  all  three  primary  colors  in  each  detector  by  exploiting  the  variation  of  the 
radiation  absorption  coefficient  of  silicon  with  wavelength  and  depth.  This  capability  of 
detecting  the  three  primary  colors  in  each  detector  and  therefore  in  each  pixel  gives  the 
FOVEON  sensor  three  times  the  resolution  of  a  traditional  focal  plane  with  the  same 
number  of  detectors. 


fc  ig  ir 


Figure  1.  HVDUO  5M  Camera  (left).  The  three  p-n  junctions  in  a  FOVEON  pixel 

(right)  [4] 


The  marketed  purpose  of  the  FOVEON  detector  is  for  utilization  in  the  visible 
spectrum  range,  but  its  unique  triple  well  construction  also  gives  it  the  added  ability  to 
detect  NUV  in  the  shallowest  well  and  NIR  in  the  deepest  well.  This  essentially  makes 
the  FOVEON  sensor  a  multispectral  detector.  It  was  shown  by  Cheak  [4]  that  the 
FOVEON  detection  capability  coupled  with  selected  spectral  filters  could  produce 
images  in  the  NUV,  visible,  NIR  and  in  combinations  of  all  three  spectral  bands.  It  is  this 
ability  of  the  FOVEON  sensor  to  detect  non-visible  electromagnetic  radiation  especially 
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in  the  NIR  that  makes  it  a  potential  Counter-CC&D  tool.  Analysis  of  the  NIR  reflectance 
from  objects  in  the  scene  can  aid  in  distinguishing  natural  from  man-made  objects. 


C.  OVERVIEW  OF  DIGITAL  IMAGERY  PROCESSING  AND  ANALYSIS 

Due  to  increased  processing  power,  memory  capacity,  and  speed  of  modem 
computers,  digital  imagery  processing  and  analysis  is  now  a  viable  tool  for  all  levels  of 
technical  investigations.  As  Jahne  [5],  notes  gone  are  the  days  when  imagery  processing 
required  large  mainframe  computers  and  large  memory  storage  devices.  Today  most 
imagery  processing  can  be  done  on  standard  personal  computers.  The  wide  availability, 
low  cost,  and  ever-decreasing  size  of  computers  have  made  them  an  appropriate  tool  for 
the  warfighter  in  the  field.  Also  powerful  imagery  software  tools  are  now  available  form 
numerous  manufacturers  that  can  easily  do  the  kind  of  processing  and  analysis  that  is 
required  for  deriving  useful  information  from  raw  imagery  acquired  in  the  field. 

Digital  imagery  processing,  as  described  in  Russ  [6],  is  the  use  of  a  digital 
computer  to  (1)  improve  the  visual  appearance  of  an  image  or  (2)  to  prepare  the  image  for 
measurement  of  features  and  structures  that  are  present.  Digital  imagery  analysis  is  the 
use  of  mathematical  algorithms  to  transform  the  raw  image  in  some  preferential  way  to 
allow  the  extraction  of  arbitrary  information,  such  as  classification,  pattern  recognition 
and  edge  detection. 

1.  Digital  Imagery  Analysis  Techniques 

Digital  imagery  analysis  is  currently  being  utilized  in  countless  fields  from 
manufacturing  of  paints  to  the  study  of  the  universe.  As  illustrated  in  Environment  for 
Visualizing  Images  (ENVI)  User’s  Guide  [7],  current  digital  imagery  analysis  techniques 
can  be  generally  grouped  into  four  board  areas:  Classification,  Transformations,  Filters 
and  Analyzing  Tools. 

Imagery  classification  is  the  process  of  categorizing  each  pixel  in  the  digital  scene 
by  type  and  features.  Some  common  methods  of  classifying  a  digital  scene  are 
Parallelepiped,  Minimum  Distance,  Mahalanobis  Distance,  Maximum  Likelihood  and 
Spectral  Angle  Mapper. 
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The  goal  of  imagery  transformation  is  to  improve  the  interpretation  of  the  image 
by  transforming  it  into  another  data  space  where  the  features  in  question  can  be  more 
clearly  seen.  Transformations  are  usually  performed  by  applying  a  linear  function  thereby 
preserving  the  integrity  of  the  image.  Some  common  transformation  methods  are,  Image 
Sharpening,  Spectral  Sharpening,  Principal  Component  Analysis,  Color  Transformations, 
and  Vegetation  Indices  Transforms  such  as  Normalized  Difference  Vegetation  Index 
(NDVI)  and  Tassled  Cap. 

Filters  are  used  on  images  to  remove  certain  spatial  frequencies.  Some  common 
fdters  used  in  imagery  processing  are  Convolution,  Morphological,  Texture,  Adaptive 
and  Fourier  Filtering. 

Many  analyzing  tools  are  available  in  most  digital  imagery  analysis  software 
packages.  There  are  spectral  tools  for  analyzing  the  spectral  data  in  multispectral  and 
hyperspectral  images.  There  are  map  tools  for  image  registration,  orthorectification, 
geometric  correction,  and  mosaicking.  Some  analysis  software  also  includes  specialized 
to  tools  to  work  with  radar  imagery  and  topographical  tools  for  working  with  digital 
elevation  data. 

2.  Application  of  Digital  Imagery  Analysis  Techniques  to  Counter-CC&D 

For  the  purpose  of  analyzing  Counter-CC&D  images  the  use  of  selected  methods 
and  tools  from  all  of  the  above  areas  may  be  necessary.  Due  to  the  need  to  distinguish 
man-made  object  from  natural  objects  the  transformation  techniques  of  NDVI  will  be  the 
most  useful.  Also  the  ability  to  conduct  mathematics  of  spectral  bands  in  a  digital  image 
will  be  relied  upon  heavily. 
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III.  CHARACTERIZATION  OF  THE  FOVEON  IMAGE 

SENOR 


A.  PREVIOUS  RESULTS 

The  FOVEON  image  sensor  was  characterized  in  Cheak  [4],  but  due  to  low 
sensor  response  at  some  wavelengths  the  camera’s  built  in  processor  had  to  be  used  to 
compensate  the  output  in  order  to  obtain  adequate  measurements.  The  built  in  processor 
is  controlled  by  the  software  that  was  shipped  with  the  camera  and  would  not  be  used  for 
this  work  due  to  its  lack  of  portability.  It  was  therefore  necessary  to  re-characterized  the 
sensor  before  proceeding  with  this  work.  Also,  the  present  work  is  focus  in  the  NIR  range 
of  the  sensor.  Therefore  a  more  detailed  characterization  in  that  wavelength  range  was 
needed. 

The  goal  of  characterizing  any  image  sensor  is  to  obtain  a  plot  of  the  senor’s 
electrical  response  to  the  presence  of  light  of  a  given  intensity  at  varying  wavelengths.  To 
obtain  this  plot  it  was  necessary  to  subject  the  sensor  to  monochromatic  light  of  known 
intensity  and  measure  its  response  at  each  wavelength  of  interest.  The  sensor’s  response 
is  termed  the  “Responsivity”  of  the  detector.  Once  the  characteristic  responsivity  of  a 
detector  is  known  the  output  signal  of  that  detector  can  then  be  determined  from  the 
intensity  and  wavelength  of  future  observations  with  the  detector. 

The  work  by  Major  Cheak  confirmed  that  the  responsivity  of  the  FOVEON  image 
sensor  measured  in  the  laboratory  was  similar  to  that  which  was  provided  by  the 
manufacturer  in  the  intended  operational  range  of  450  to  700  nanometers  (nm),  the 
visible  range,  as  shown  in  Figure  1  below.  In  an  attempt  to  fully  characterize  the 
FOVEON  sensor  Major  Cheak  submitted  the  detector  to  light  ranging  from  200  nm 
(NUV)  to  1100  nm  (NIR).  There  were  numerous  difficulties  in  obtaining  measurable 
signals  in  the  range  below  400  nm.  These  difficulties  were  again  seen  in  the  present  work 
at  lower  than  400  nm.  This  low  responsivity  is  believed  to  be  the  combined  effects  of  the 
design  bias  of  the  monochromator  diffraction  grating  and  the  reflectivity  of  the  mirrors 
used  in  the  Photodetector  Characterization  System.  More  work  is  needed  to  understand 
and  overcome  these  difficulties  before  this  range  of  the  FOVEON  sensor  can  be  exploited 
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for  potential  military  application.  Since,  the  primary  focus  of  this  work  was  in  the  visible 
and  NIR  ranges  the  NUV  measurements  are  not  included  in  this  discussion. 
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Figure  2.  Foveon®  X3™  Pro  10M  CMOS  Image  Sensor  F7X3-A91 


In  order  to  exploit  the  NIR  range  of  the  FOVEON  sensor  for  Counter-CC&D 
purposes  it  was  therefore  necessary  to  generate  responsivity  curves  for  the  FOVEON 
sensor  that  extended  into  the  NIR  range  (700-  1100  nm). 


B.  OVERVIEW  OF  THE  PHOTODETECTOR  CHARACTERIZATION 
SYSTEM 

The  Computer-Controlled  Photodetector  Characterization  System  was  created  by 
LCDR  Herdlick  as  his  Naval  Postgraduate  School  Thesis  work.  Herdlick  [8]  was  used  to 
operate  the  characterization  system  for  studying  the  FOVEON  sensor  both  in  this  work 
and  Cheak  [4],  The  system  is  depicted  below  in  Figure  3.  The  system  consisted  of  an 
analysis  computer,  a  light  source,  a  monochromator,  two  lock-in  amplifiers  and  an 
assortment  of  mirrors  and  detector  connection  points  assembled  on  a  light  bench.  There  is 
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also  a  thermally  controlled  sensor  housing  to  be  used  with  cooled  IR  sensors.  This 
portion  of  the  system  was  not  used  for  this  work. 


Light 

Source 


Monochromator 


Lockin 

Amps. 


Mirrors 


Light  Bench  with 
connecting  points 


Analysis 

Computer 


Figure  3.  Photodetector  Characterization  System.  Taken  from  reference  [8] 


In  addition  to  the  existing  characterization  system  the  reference  silicon 
photodiode,  model  PIN  UV-035D,  serial  number  7309  used  in  Cheak  [4]  was  again  used. 
Calibration  details  for  the  reference  silicon  photodiode  can  be  found  in  Appendix  A.  An 
aluminum  coated  splitting  mirror  was  added  to  divide  the  light  from  the  monochromator 
evenly  between  the  FOVEON  sensor  and  the  reference  photodiode. 


C.  CHARACTERIZATION  RESULTS 

Additional  details  of  the  FOVEON  image  sensor  characterization  including 
spreadsheets  and  additional  graphs  can  be  found  in  Appendix  B.  The  basic  approach  and 
the  results  are  summarized  here.  The  FOVEON  sensor  and  the  reference  photodiode  were 
arranged  to  receive  equal  portions  of  the  light  emitted  from  the  monochromator,  as  shown 
in  Figure  4.  The  Photodetector  Characterization  System  was  controlled  by  the  LAB  VIEW 
controlled  program  written  in  Herdlick  [8],  The  LAB  VIEW  program  also  adjusted  the 
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wavelength  of  the  light  coming  from  the  monochromator  and  collected  the  readings  from 
the  reference  photodiode.  As  in  Cheak  [4]  the  readings  from  the  FOVEON  sensor  was 
obtained  by  taking  picture  at  each  wavelength  by  utilizing  the  control  and  imagery 
progressing  software  that  came  with  the  camera.  The  collected  data  was  then  exported 
into  a  spreadsheet  and  the  graphs  were  created  based  on  the  collected  data. 

Using  the  detector  area  of  the  reference  photodiode  and  the  FOVEON  sensor 
provided  by  the  manufacturers  and  the  size  of  the  incident  light  beam  an  effective  area 
for  each  detector  was  calculated  for  use  in  the  responsivity  calculating  spreadsheet.  The 
width  of  the  incident  light  beam  was  estimated  to  be  the  width  of  the  monochromator 
output  slit  assuming  negligible  spreading  of  the  beam  over  the  focal  length  of  the  mirrors 
which  was  4.7  inches. 


Figure  4.  Picture  of  FOVEON  Detector  and  Reference  Photodiode  on  bench 
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Some  mathematical  manipulations  of  the  data  were  required  to  arrive  at  the 
responsivity  of  each  of  the  three  photodetectors  that  makes  up  each  of  the  FOVEON 
sensor  pixel.  The  calculations  used  are  as  follows: 

Using  the  known  responsivity  of  the  reference  photodiode  as  a  function  of 
wavelength,  Rref  (X)  listed  in  Appendix  A  and  the  measured  signal  of  the  reference 
photodiode,  Sref  (A)  the  power  incident  on  the  reference  photodiode  can  be  calculated  as: 


Pref(^  =  Sref(k)/Rref(k) 


(1) 


By  dividing  the  power  incident  on  the  reference  photodiode  by  the  area  of  the  reference 
photodiode  the  intensity  of  the  light  that  is  incident  on  both  the  reference  photodiode  and 
the  FOVEON  sensor  can  be  found  as: 


kef (k)  -  IfOV  (k)  -  Pref(k)  /  Aref 


(2) 


By  multiplying  the  light  intensity  by  the  area  of  the  FOVEON  sensor  the  power  incident 
on  the  FOVEON  detector  can  be  found  as: 


Pfov  (k)  -  Ifov  (X)  x  Afov 


(3) 


With  the  incident  power  on  the  FOVEON  sensor  and  the  measured  signal  from  the 
FOVEON  sensor  the  responsivity  of  each  of  the  three  FOVEON  photodetectors  can  be 
determined  as: 


Rfov  (X)  -  Sfov  (k)  /  Pfov  (X) 


(4) 
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The  resulting  graphs  of  the  measured  FOYEON  responsivity  in  the  NIR  range 
(700  -  1100  nm)  are  shown  in  Figure  4  below.  A  pseudo-NIR  responsivity  curve  was 
also  generated  by  subtracting  the  green  code  band  from  the  red  color  band.  This  was  done 
based  on  the  fact  that  the  long  wavelengths  in  the  NIR  range  pass  through  both  the  blue 
and  the  green  photodetector  before  being  recorded  in  the  red  photodetector.  The 
derivation  of  this  pseudo-NIR  will  be  more  fully  addressed  later  in  chapter  five. 


FOVEON  Detectors  Responsity  vs.  Wavelength 


Wavelength  [nm] 


— •—  Red  Responsivity 
-■-Green  Responsivity 
Blue  Responsivity 
NiR  Responsity 


Figure  5.  FOVEON  Detectors  Responsivity  vs.  Wavelength 


14 


IV.  HARDWARE 


A.  THE  FOVEON  SENSOR  TO  THE  FRAME-GRABBER 

The  goal  of  this  work  was  to  create  a  portable  imagery  system  that  can  be  used  in 
the  field  to  counter  camouflage  and  deception  to  achieve  this  end  it  was  necessary  for  the 
FOVEON  camera  be  mated  to  a  portable  computer.  The  frame-grabber  and  analysis 
software  used  in  Cheak  [4]  were  not  available  in  portable  versions  therefore  a  new  frame- 
grabber  was  needed  that  would  work  with  the  FOVEON  camera  and  a  standard  laptop 
computer.  The  signal  output  of  the  FOVEON  camera  supported  the  Camera- Link™ 
specifications,  which  is  an  interface  standard  for  digital  cameras  and  frame-grabbers. 

The  job  of  a  frame-grabber  is  to  capture  digital  video  data  from  a  camera  and 
transfer  it  into  the  memory  of  a  host  computer.  A  FRAMELINK™  frame-grabber  made 
by  Imperx  Incorporated  was  chosen  based  on  its  support  for  Camera-Link™  and  its 
rugged  design.  Camera-Link™  is  a  registered  trade  mark  of  the  National  Semiconductor 
Corporation  which  created  it  based  on  ANSI/TIA/EIA-644  general  purpose  interface 
standard.  Camera-Link™  uses  Low  Voltage  Differential  Signaling  (LVDS),  which  is  a 
high-speed,  low-power  signal  protocol  that  is  capable  of  data  transfer  speeds  up  to  1.9 
Gbps,  as  noted  in  the  specifications  of  the  Camera  Link  Interface  Standard  for  Digital 
Cameras  and  Frame  Grabbers  [9].  Camera-Link™  transfer  data  over  a  connecting  cable 
as  shown  in  Figure  5. 
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Figure  6.  Camera-Link  Operation.  Taken  from  Reference  [9] 
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The  FRAMELINK™  frame-grabber  came  with  an  application  that  configures  the 
frame-grabber  to  the  specifications  of  each  camera,  thereby  allowing  the  capture  of 
images  from  that  camera.  The  required  specification  for  the  FOVEON  camera  was 
arrived  at  by  a  combination  of  communications  with  the  manufacturers  of  the  frame- 
grabber  and  the  camera  and  trial  and  error.  The  specification  that  resulted  in  successful 
operation  was  saved  in  a  configuration  file  (.cam)  in  Appendix  D  and  below  in  Figure  6. 


Figure  7.  Frame-Grabber  FOVEON  Specification 


B.  THE  FRAME-GRABBER  TO  THE  IMAGERY  ANALYSIS  SOFTWARES 

The  frame-grabber  application  software  facilitated  the  capture  of  images  from  the 
camera  and  gave  the  option  of  saving  the  images  in  one  of  three  image  format,  (Bitmap, 
JPEG,  or  TIFF).  TIFF  was  found  to  be  the  best  format  for  the  import  of  imagery  into  the 
analysis  software.  The  chosen  imagery  analysis  software  for  this  work  was  ENVI® 
(Environment  for  Visual  Images).  ENVI®,  (here  after  referred  to  as  ENVI)  is  an 
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innovative,  user-friendly  environment  written  in  Interactive  Data  Language  (IDL®), 
(here  after  referred  to  as  IDL).  ENVI  and  IDL  are  registered  trademarks  of  Research 
System  Incorporated  (RSI).  The  images  were  also  manipulated  in  IDL  as  a  faster  but 
more  code  intensive  means  for  deriving  the  intelligence  valve.  Operation  guidance  for 
ENVI  was  found  in  ENVI  [7],  and  for  IDL  in  the  IDL  Users  Manual  [10]. 

The  saved  imagery  from  the  camera  was  imported  into  ENVI  and  IDL  as  three 
color  band  RGB  images.  This  allowed  each  of  the  three  color  bands  to  be  manipulated 
separately.  With  the  imagery  analysis  tools  in  ENVI  and  the  programming  power  of  IDL 
it  is  then  possible  to  perform  mathematical  operations  on  the  color  bands  to  extract  the 
NIR  data  and  use  it  to  determine  the  vegetation  index  of  a  digital  image  scene.  A 
vegetation  index  enhanced  image  would  facilitate  the  identification  of  non-vegetation 
type  objects  in  a  vegetation  intense  environment. 

C.  THE  PORTABLE  IMAGERY  EXPLOITATION  SYSTEM 

The  portable  imagery  exploitation  system  as  shown  in  Figure  8,  is  comprised  of 
the  FOVEON  camera,  a  custom  filter  holder,  the  frame-grabber  with  connecting  cable 
and  the  laptop  computer  running  ENVI  and/or  IDL  as  a  imagery  exploitation  tool.  The 
goal  of  this  work  is  to  create  an  easy  to  use  system  with  few  attachments. 


Figure  8.  The  Imagery  Exploitation  System 
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V.  IMAGERY  PROCESSING 


A.  EXTRACTING  AND  EXPLOITING  THE  NIR  SIGNAL 

To  utilize  the  Normalized  Difference  Vegetation  Index  (NDVI)  as  a  means  of 
detecting  vegetation  in  a  scene  the  presence  of  a  separate  NIR  band  is  needed,  since 
NDVI  is  a  function  of  the  difference  between  the  reflectance  in  the  NIR  band  and  the  red 
band  as  seen  in  equation  (5)  below.  The  imported  FOVEON  images  only  consisted  of 
three  color  bands;  red,  green  and  blue  (RGB).  The  generation  of  a  separate  NIR  band 
from  the  FOVEON  image  is  needed.  The  physical  design  of  the  FOVEON  sensor  results 
in  the  NIR  signal  being  primarily  detected  in  the  deep  photodetector.  As  was  discussed  in 
Cheak  [4],  long  wavelength  radiation  passes  through  and  interacts  with  all  three 
photodetectors  in  FOVEON  sensor,  but  due  to  the  relatively  thin  absorption  region  in  the 
upper  photodetectors  the  response  is  minimal.  The  main  interaction  of  the  red  and  NIR 
radiation  is  the  green  and  red  photodetectors.  It  was  therefore  theorized  that  the 
subtraction  of  the  green  photodetector  response  from  the  red  photodetector  response 
would  result  in  an  approximate  representation  of  the  NIR  signal. 
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Figure  9.  FOVEON  camera  absorption  mechanism  for  various  wavelengths  [4], 
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To  test  the  above  theory  a  pseudo-NIR  image  was  created  using  the  above  theory 
then  compared  against  an  image  taken  with  a  NIR  filter  installed  to  block  all  light  below 
the  NIR  band.  The  two  images  are  compared  below  in  Figure  10.  The  scene  is  of  a  potted 
plant  with  bushes  to  the  left  and  two  concrete  pillars  and  more  bushes  in  the  background. 
Vegetation  in  the  scene  is  more  reflective  in  the  NIR  band  than  non-vegetation  therefore 
the  vegetation  appear  brighter. 


Figure  10.  Pseudo-NIR  [left]  compare  to  NIR  with  filter  [right] 


The  above  demonstrates  that  the  extraction  of  the  NIR  information  from  the  red 
and  green  color  bands  by  mathematical  manipulation  provides  a  reasonable 
approximation  of  the  true  NIR  reflectance.  This  will  be  used  in  the  imagery  progressing 
that  follows. 

1.  Creation  of  NIR,  NDVI  and  Probable  Non- Vegetation  Image  Using  ENVI 

NDVI  is  able  to  indicate  vegetation  due  to  the  differential  reflectance  of 
vegetation  in  red  band  (580  -  680  nm)  and  the  NIR  band  (750  -  1 100  nm).  As  can  be 
seen  in  Figure  1 1  below  vegetation  exhibits  a  sharp  rise  spectral  reflectance  around  700 
nm.  This  sharp  rise  in  reflectance  is  often  referred  to  as  the  vegetation  IR  ledge.  The 
NDVI  calculation  exploits  the  IR  ledge  to  detect  the  presence  of  vegetation  in  the  image 
scene. 
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Material  Reflectance  (Ref:  http://speclib.jpl.nasa.gov/) 
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Figure  1 1 .  Spectral  Reflectance  of  various  material  and  vegetation  versus  wavelength 

from  NASA  JPL 

Images  from  the  FOVEON  camera  saved  in  Tagged  Image  File  format  (TIFF)  are 
loaded  directly  into  ENVI.  In  addition  to  displaying  the  image  as  a  RGB  color  image, 
ENVI  can  also  display  each  color  band  separately.  This  allows  mathematical  operations 
on  each  band.  The  pseudo-NIR  band  was  created  in  ENVI  by  using  one  of  the  built-in 
basic  tools  called  “Band  Math”.  ENVI  gave  the  option  of  conducting  a  mathematical 
operation  to  subtract  the  green  color  band  from  the  red  color  band  to  create  the  NIR  band 
and  then  to  conduct  another  operation  to  create  an  NDVI  grayscale  image  as  follows: 


NDVI  =  [NIR  -Red)/ [NIR  +  Red) 


(5) 


There  is  also  the  option  of  creating  a  user  defined  “FUNCTION”  written  in  IDL 
to  execute  both  operations  plus  more.  The  below  sample  “FUNCTION”  called  “detect 
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non-veg”  was  used  to  calculate  the  NIR  band,  then  used  the  NIR  band  to  calculate  NDVI 
and  then  created  an  image  showing  the  probable  locations  in  the  scene  where  non¬ 
vegetation  exists. 


{An  user  define  Band  Math  function  for  uses  in  ENVI  to  calculate  NIR, 

NDVI  and  probable  non-vegetation  written  in  IDL} 

FUNCTION  detect_non_veg,  bl,  b2 
NIR  =  float(bl)-float(b2) 

NDVI  float  =  (NIR  -  bl)  /  (NIR  +  bl) 

NDVI  =  BYTSCL(NDVI_float,  min=-3,  max=5) 

NON_VEG  =  NDVI  LT  MEAN (NDVI) 

RETURN,  NONVEG 
END 

Figure  12.  ENVI  /  IDL  function  to  detect  non- vegetation 

The  advantage  of  using  a  full  imagery  processing  software  application  like  ENVI 
is  the  availability  of  numerous  powerful  imagery  manipulation  tools  that  can  be  used  to 
enhance  the  displayed  image  to  aid  in  target  detection.  The  disadvantage  is  the  time 
required  to  accomplish  the  progressing  due  to  the  numerous  menus  that  have  to  be 
navigated.  A  full  and  flexible  imagery  processing  application  like  ENVI  is  more 
appropriate  in  post-processing  applications  vice  the  near-real  time  processing  that  is 
required  for  operations  in  the  field. 


2.  Creation  of  NIR,  NDVI  and  Probable  Non-Vegetation  Image  Using  IDL 

Using  the  Interactive  Data  Language  (IDL),  the  language  that  ENVI  was  written 
in,  it  is  possible  to  conduct  the  required  imagery  processing  in  near-real  time.  This 
required  creating  and  compiling  a  program  written  in  IDL  to  load  the  input  image, 
conduct  the  band  mathematics  to  create  the  NIR  band,  and  then  calculates  the  NDVI  to 
detect  the  probable  locations  of  non-vegetation  items  in  the  scene.  A  sample  program  that 
achieves  this  is  listed  in  Appendix  E.  The  image  depicted  below  in  Figure  13  was  used  as 
the  input  image  for  the  program.  Note  that  with  the  manufacturer’s  NUV/NIR  blocking 
filter  removed  the  colors  in  the  image  scene  are  skewed  due  to  the  NIR  radiation 
reflecting  off  the  green  vegetation  and  being  detected  in  red  color  bands.  When  the 
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blocking  filter  is  re-installed  the  scene  appears  normal  in  color  as  seen  in  Figure  14.  Also 
note  how  much  brighter  the  image  that  includes  the  NIR  reflectance  is  compare  to  the 
same  scene  without  the  NIR. 


Figure  13.  Annotated  scene  used  as  input  image  to  IDL  Non- Vegetation  detection 

program 


Figure  14.  Above  scene  with  NUV/NIR  blocking  filter  installed 
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With  Figure  13  as  the  input  file  to  the  IDL  program  the  below  output  images  files 
were  created  and  displayed. 


Figure  15.  Input  image  [left],  IDL  created  NIR  image  [right] 


Figure  16.  IDL  created  NDVI  image  [left],  IDL  created  non- vegetation  image  [right] 

As  can  be  seen  in  the  above  images  exploiting  the  NIR  reflectance  of  vegetation 
can  be  used  to  enhance  the  appearance  of  non  vegetation  in  a  scene  even  in  a  low  light 
condition. 
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VI.  EXPLOITING  CC&D  IMAGERY  IN  THE  FIELD 


After  the  development  of  the  imagery  exploitation  hardware  and  the  creation  and 
testing  of  the  software  under  laboratory  conditions  the  next  step  was  to  take  the  system 
into  the  field  and  test  it  against  pseudo  camouflage  and  deception  targets.  Due  to  the  lack 
of  accessibility  to  real  camouflage  and  deception  targets  in  the  immediate  area,  accessible 
scene  in  the  local  area  were  used  to  test  the  capability  of  the  imagery  system.  One 
problem  that  was  encountered  when  the  system  was  exposed  to  full  sunlight  was  the  issue 
of  over-exposure.  As  was  seen  above  adding  in  the  NIR  reflectance  greatly  increases  the 
brightness  of  the  scene.  When  this  was  done  in  full  sunlight  the  images  were  over¬ 
saturated.  This  required  carefully  reducing  the  shutter  opening  to  limit  the  exposure. 
Once  the  over-exposure  problem  was  adjusted  for  the  three  scenes  below  were  imaged  in 
an  attempt  to  re-create  typical  counter-CC&D  scenes  that  may  be  encountered  on  the 
battlefield. 

A.  WIDE  AREA  SCENE  WITH  HIDDEN  OBJECTS  IN  THE  TREE  LINE 

The  first  scene  is  of  a  dense  tree  lined  area  with  numerous  man  made  objects 
hidden  amongst  the  trees.  The  first  image  below,  Figure  17,  was  taken  with  the 
manufacture’s  NUV/NIR  blocking  filter  installed  therefore  it  only  shows  the  information 
available  in  the  visible  range.  One  items  of  note  in  this  scene  is  the  faint  power  lines 
running  horizontally  across  the  image.  These  could  present  an  aircraft  navigation  hazard 
in  an  unknown  area.  Notice  how  the  power  lines  are  more  visible  when  the  NIR  reflection 
of  the  trees  is  enhanced  in  Figure  19. 
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Figure  17.  Wide  Area  Scene  with  the  NUV/NIR  blocking  filter  in  place 


There  is  also  a  building  in  the  background  with  two  cars  parked  in  front.  The 
building  is  almost  invisible  in  the  Figure  17  above  because  it  is  grey-brown  in  color 
thereby  blends  well  into  the  natural  background.  The  two  cars  in  front  of  the  building  are 
partially  visible  due  to  the  sun  reflecting  off  their  silver  colored  reflecting  surface.  This 
would  not  be  the  case  if  they  were  painted  a  flat  camouflage  color. 


Figure  18.  Wide  Area  Scene  without  the  NUV/NIR  blocking  filter 

In  Figure  19  the  two  parked  cars  shows  up  as  notable  dark  spots  against  the  NIR 
enhanced  background  indicating  that  they  are  clearly  non-vegetation. 
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Figure  19.  NIR  enhance  image  of  Wide  Area  Scene 


Also  from  the  stand  point  of  monitoring  vegetation  health,  the  tree  in  the  lower 
left  hand  comer  of  Figure  19  is  reflecting  almost  no  NIR  indicating  possible  poor  health. 


B.  A  WOODED  SCENE  WITH  CONCEALED  ENTRANCE 

The  second  scene  is  of  a  wooded  area  with  a  partially  concealed  underground 
entrance  way  to  an  adjacent  building,  Figure  20.  This  type  of  concealment  is  a  common 
method  of  hiding  the  entrance  to  underground  bunkers.  This  image  was  taken  from  the 
roof  of  a  nearby  six  floor  building.  It  is  somewhat  representative  of  a  low  flying  airborne 
photograph.  In  the  visible  range  the  entrance  is  partially  blocked  by  the  trees  and  brushes 
and  not  very  visible  to  the  observer.  If  it  was  painted  to  blend  in  with  the  natural 
surroundings  this  entrance  would  be  easily  missed  by  an  airborne  reconnaissance 
platform. 
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Figure  20.  Wooded  Scene  with  Concealed  Entrance  [visible  range] 


When  the  NIR  reflected  by  the  vegetation  is  used  to  enhance  the  scene, 
Figure  21,  the  entrance  stands  out  as  dark  spot  in  a  mostly  light  background.  This 
contrast  should  be  enough  to  alert  an  operator  to  investigate  this  area  more. 
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C.  VEHICLES  CONCEALED  BY  TREES  AND  BUSHES 

The  third  scene  below  in  Figures  22  and  23  demonstrates  the  imagery  systems 
capability  to  detect  vehicles  hidden  in  dense  vegetation.  Some  of  the  parked  cars  are 
somewhat  visible  in  Figure  22  due  to  their  light  coloring  and  glossy  finish  which  serves 
to  reflects  sunlight.  If  they  were  painted  in  flat  camouflage  paint  it  would  be  harder  to 
distinguish  them  in  this  vegetation  rich  scene.  In  the  NIR  enhanced  image  the 
surrounding  vegetation  becomes  a  light  background  making  it  easier  to  detect  to  vehicles 
behind  the  trees  and  bushes,  as  shown  in  Figure  23  below. 


Figure  22.  Vehicles  Concealed  by  Vegetation  [visible  range] 
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Figure  23.  Vehicles  Concealed  by  Vegetation  [NIR  range] 


Note  how  the  outline  of  the  vehicles  begins  to  emerge  in  the  NIR  enhanced 
image.  With  the  use  of  additional  imagery  progressing  tools  it  may  be  possible  to  create 
even  more  contrast  between  the  vehicles  and  the  background  to  the  point  where  an 
automated  detection  program  would  be  able  to  detect  them. 
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VII.  POTENTIAL  APPLICATIONS 


A.  MILITARY  APPLICATIONS 

There  is  a  need  for  an  inexpensive  and  portable  counter-CC&D  sensor  in  the 
modem  battlefield.  As  was  pointed  out  the  introduction  chapter  the  current  counter- 
CC&D  sensors  are  not  portable,  not  mature  enough,  or  too  expensive  to  be  used  in  board 
applications  across  the  military.  The  light  weight  and  low  cost  of  a  FOVEON  based 
counter-CC&D  system  makes  it  suitable  for  applications  in  numerous  military  mission 
areas. 

1.  On  the  Battlefield 

The  small  size  and  lightweight  of  the  FOVEON  camera  makes  it  an  ideal 
accompany  to  the  small  ruggedized  computers  that  are  being  used  on  today’s  battlefield. 
The  Army  and  Marine  Corps  currently  use  computers  on  the  battlefield  in  M1A2  Abrams 
Main  Battle  Tanks,  in  M2A3  Bradley  Fighting  Vehicles  and  as  numerous  handheld,  tablet 
and  notebook  computers  for  foot  soldiers  applications.  Some  examples  are  depicted 
below. 


Tablet  PCs 

rt*gqHfd  ii-"j  ■  j-|i|r-> 


Wireless  Mobility 
Software 


Figure  24.  Samples  of  Military  portable  PCs  form  the  Itronix  Military  Solutions 
http://www.itronix.com/industry  solutions/military.asp  November  2005 
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Imagery  sensors  are  currently  deployed  on  the  modem  battlefield  in  support  of  the 
Net-Centric  Warfare  Concept.  The  goal  is  to  provide  situational  awareness  of  the  whole 
battlefield  to  every  soldiers  and  every  command  center  in  hopes  of  maximizing  the  battle 
efficiency  of  a  smaller,  but  more  technologically  enhanced  fighting  force.  Digital  video 
cameras  are  already  in  use  to  provide  this  situational  awareness  so  the  addition  of  a  new 
piece  of  gear  is  not  an  issue.  The  replacement  of  some  of  the  existing  digital  cameras 
with  FOVEON  cameras  and  the  addition  of  another  software  application  is  all  that  is 
required  to  integrate  the  FOVEON  sensor  into  the  modem  battlefield.  The  FOVEON 
camera  is  small  enough  to  be  helmet  mounted  and  have  the  video  signal  fed  back  to  a 
remote  computer  for  analysis. 


2.  Aerial  Reconnaissance 

The  FOVEON  camera  can  also  be  used  to  replace  the  digital  camera  in  a  UAV  or 
manned  reconnaissance  aircraft.  Due  to  the  unique  triple  well  Photodetector  design  the 
FOVEON  camera  has  three  times  the  image  resolution  of  a  normal  digital  camera  with 
the  same  amount  of  pixels  so  upgrading  to  the  FOVEON  camera  will  significantly 
improve  the  normal  picture  quality.  With  some  simple  modifications  the  FOVEON 
camera  could  easily  function  both  as  a  high-resolution  visible  range  camera  and  as  a 
counter-CC&D  multi-spectral  sensor.  For  the  UAV  operation  the  imagery  signal  sent 
from  the  camera  can  be  analyzed  remotely  in  the  same  manner  that  is  currently  being 
used  for  other  UAV  signals. 


B.  CIVIL  APPLICATIONS 

Commercial  crop  growers  and  the  National  Forest  Service  current  use  multi- 
spectral  and  hyper-spectral  satellite  and  airborne  imagery  to  determine  the  health  of 
vegetation.  The  acquisition  of  satellite  and  airborne  imagery  is  costly  due  to  the  limited 
available  and  the  high  cost  of  the  imaging  systems  and  platforms.  The  use  of  a  FOVEON 
based  imagery  analysis  system  can  be  a  low  cost  alternate.  In  this  application  NDVI  will 
be  used  has  a  direct  indicator  of  crop  health  by  monitoring  its  value.  The  value  of  NDVI 
ranges  from  -1  to  +1,  the  higher  the  NDVI  value  the  healthier  the  crop. 
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VIII.  SUMMARY  AND  RECOMMDATIONS 


A.  SUMMARY  OF  THIS  RESEARCH 

The  research  conducted  in  this  work  indicated  that  the  FOVEON  image  sensor 
could  be  used  in  the  counter-CC&D  military  mission  area  due  to  its  ability  to  detect  light 
in  the  NIR  range.  The  low  cost  and  high  portability  of  the  FOVEON  sensor  makes  it 
attractive  for  use  on  the  battlefield.  By  replacing  some  of  the  digital  cameras  currently 
being  used  in  the  military  and  the  addition  of  imagery  application  software  it  is  possible 
to  add  a  counter-CC&D  sensor  to  the  battlefield  at  very  little  cost.  This  work  was  done 
using  one  of  the  earliest  models  of  the  FOVEON  focal  array,  a  1.51  megapixels  physical 
(effectively  4.53  megapixels,  due  to  the  triple  well  structure).  This  camera  only  had  an  8 
bit  dynamic  range,  which  gave  pixel  value  ranging  form  0  to  255  (0  to  28).  The  quality  of 
the  imagery  in  this  research  was  limited  by  these  factors.  The  FOVEON  focal  array  is 
now  available  in  3.43  megapixels  physical  (10.29  megapixels  effective)  and  with  higher 
dynamic  ranges.  The  utilization  of  a  current  FOVEON  array  should  more  than  double  the 
resolution  and  dynamic  ranges  seen  in  this  research.  The  addition  of  a  more  advanced 
frame  grabber  that  can  provide  more  control  of  the  camera’s  functionality  will  improve 
the  quality  and  the  ease  of  operation  of  the  imagery  system. 

B.  RECOMMENDATIONS  FOR  APPLICATIONS  AND  FOLLOW-ON 

STUDIES 

1.  Upgrade  and  Use  in  Training  Exercises 

Given  the  limitations  of  the  early  model  camera  used  in  this  research  work  it  is 
recommended  that  a  later  model  FOVEON  camera  and  a  more  advanced  frame  grabber 
be  acquired  and  mated  to  the  imagery  exploitation  system.  This  upgraded  system  should 
then  be  used  against  real  CC&D  targets.  Following  the  successful  employment  against 
real  targets  it  should  be  put  into  the  hands  of  troops  a  training  environment.  This  will 
serve  to  get  users  feedback  which  can  be  used  to  modify  the  software  and  hardware  to 
improve  its  performance. 
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2.  Conduct  Further  Research  to  Exploit  the  NUV  Detection  Range 

The  FOVEON  sensor  was  shown  in  Cheak  [4]  to  detect  near-ultra  violet  light 
(200  -  400  nm).  Further  study  is  needed  to  understand  and  find  potential  uses  for  the 
focal  array  in  this  range.  Exploiting  the  UV  absorption  characteristics  of  vegetation  as 
compared  to  that  of  non-vegetation  can  add  another  tool  for  detecting  man-made  targets 
in  vegetation  rich  environment. 


3.  Use  of  Multiple  Spectral  Band  Pass  Filters  to  Narrow  Detection 
Ranges 

With  the  addition  of  multiple  narrow  band  pass  spectral  filters  the  spectral  range 
of  the  FOVEON  sensor  of  200  nm  to  1100  nm  would  be  broken  into  narrows  bands  to 
enable  further  exploitation  of  the  deferential  reflectance  of  objects  in  the  image  scene.  As 
was  shown  in  Figure  11,  the  plot  of  the  spectral  reflectance  of  various  man-made  and 
natural  materials,  each  material  has  a  unique  spectral  reflectance  signature.  With 
narrower  spectral  filters  it  may  be  possible  detect  specific  materials  in  a  scene. 
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APPENDIX  A  -  REFERENCE  PHOTODIODE  RESPONSITY 

VALUES  AND  CURVE 


Below  are  the  calibrated  responsivity  values  and  curve  for  the  reference  silicon 
photodiode  that  was  provided  by  the  manufacturer  that  was  used  in  the  characterization 
of  the  FOVEON  sensor. 


Wavelength 

Responsivity 

(A/W) 

Wavelength 

Responsivity 

(A/W) 

Wavelength 

Responsivity 

(A/W) 

200 

0.07 

500 

0.242 

800 

0.413 

210 

0.073 

510 

0.25 

810 

0.423 

220 

0.084 

520 

0.256 

820 

0.429 

230 

0.09 

530 

0.262 

830 

0.435 

240 

0.094 

540 

0.268 

840 

0.44 

250 

0.089 

550 

0.275 

850 

0.445 

260 

0.082 

560 

0.281 

860 

0.45 

270 

0.076 

570 

0.288 

870 

0.455 

280 

0.073 

580 

0.294 

830 

0.46 

290 

0.087 

590 

0.3 

890 

0.464 

300 

0.099 

600 

0.305 

900 

0.472 

310 

0.106 

610 

0.31 

910 

0.477 

320 

0.11 

620 

0.315 

920 

0.481 

330 

0.113 

630 

0.322 

930 

0.486 

340 

0.115 

640 

0.329 

940 

0.491 

350 

0.101 

650 

0.334 

950 

0.494 

360 

0.102 

660 

0.34 

960 

0.499 

370 

0.104 

670 

0.346 

970 

0.499 

380 

0.114 

680 

0.351 

930 

0.501 

390 

0.131 

690 

0.357 

990 

0.496 

4D0 

0.147 

700 

0.361 

1000 

0.487 

410 

0.161 

710 

0.367 

1010 

0.472 

420 

0.174 

720 

0.373 

1020 

0.447 

430 

0.185 

730 

0.379 

1030 

0.413 

440 

0.194 

740 

0.384 

1040 

0.369 

450 

0.204 

750 

0.39 

1050 

0.318 

460 

0212 

760 

0.396 

1060 

0.262 

470 

0.221 

770 

0.402 

1070 

0.216 

480 

0.229 

780 

0.407 

1080 

0.18 

490 

0.236 

790 

0.412 

1090 

0.149 

1100 

0.121 

Table  1.  Reference  Silicon  Photodiode  Model  UV-035D  Calibration  Table 
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Figure  25.  Reference  Silicon  Photodiode  Model  UV-035D  Calibration  Chart 
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APPENDIX  B  -  CHARACTERIZATION  MEASUREMENTS  OF  THE 

REFERENCE  PHOTODIODE 


Characterization  Mesurements  of  the  Silicon  Reference  Photodiode 


Ref  Diode 


Wavelength  Range 

Exposure 
time  [ms] 

Amp  Sensity 

Monochrometer  Slit 

Lamp  Current 

Exposure 
Area  [mm2] 

450.00  1100.00 

30.00 

300.00  mV 

0.30  mm 

7.00  A 

1.74 

Ref 


Wavelength  [nm] 

Ref  Detector  Signal 

Responsivity 

Ref  Power 

Intensity 

Run 

mV 

A 

A/W 

W 

W/mm2 

450 

1.050105 

1.0501  E-09 

0.204 

5.14757E-09 

2.95838E-09 

460 

1.650165 

1  6502E-09 

0.212 

7.7838E-09 

4.4734 5E-09 

470 

2.70027 

2.7003E-09 

0.221 

1.22184E-08 

7.02208E-09 

480 

4.170417 

4  1704E-09 

0.229 

1.821 14E-08 

1.04663E-08 

490 

6.30063 

6  3006E-09 

0.236 

2.66976E-08 

1.53434E-08 

500 

8.670867 

8.67D9E-09 

0.242 

3.583E-08 

2.0592E-08 

510 

11.61116 

1.161  IE-08 

0.25 

4.64446E-08 

2.66923E-08 

520 

15.39154 

1.5392E-08 

0.256 

6.01232E-08 

3.45536E-08 

530 

20.16202 

2.0162E-08 

0.262 

7.69543E-08 

4.42266E-08 

540 

25.86259 

2.5863E-08 

0.268 

9.65022E-08 

5.5461  E-08 

550 

31.92319 

3.1923E-08 

0.275 

1.16084E-07 

6.671 51 E-08 

560 

39.12391 

3.9124E-08 

0.281 

1.39231  E-07 

8.00178E-08 

570 

47.28473 

4  7285E-08 

0.288 

1.64183E-07 

9.43581  E-08 

580 

52.71527 

5.271 5E-08 

0.294 

1.79304E-07 

1.03048E-07 

590 

58.86589 

5.8866E-08 

0.3 

1.9622E-07 

1.1277E-07 

600 

66.90669 

6.6907E-08 

0.305 

2.19366E-07 

1.26073E-07 

610 

75.69757 

7  5698E-08 

0.31 

2.44186E-07 

1.40337E-07 

620 

85.0285 

8.5029E-08 

0.315 

2.69932E-07 

1.55133E-07 

630 

90.39904 

9.0399E-08 

0.322 

Z80742E-07 

1.61346E-07 

640 

103.3003 

1.033E-07 

0.329 

3.13983E-07 

1.8045E-07 

650 

113.8614 

1  1386E-07 

0.334 

3.40902E-07 

1.95921  E-07 

660 

122.2022 

1.222E-07 

0.34 

3.5941 8E-07 

2.06562E-07 

670 

128.5929 

1  2859E-07 

0.346 

3.71656E-07 

2.13595E-07 

680 

134.4134 

1  3441  E-07 

0.351 

3.82944E-07 

2.20083E-07 

690 

141.2841 

1  4128E-07 

0.357 

3.95754E-07 

2.27445E-07 

700 

149.2949 

1  4929E-07 

0.361 

4.13559E-07 

2.37678E-07 

710 

159.0159 

1  5902E-07 

0.367 

4.33286E-07 

2.4901 5E-07 

720 

166.7267 

1  6673E-07 

0.373 

4.46988E-07 

2.5689E-07 

730 

173.3573 

1.7336E-07 

0.379 

4.57407E-07 

2.62878E-07 

740 

178.6079 

1.7861  E-07 

0.384 

4.65125E-07 

2.6731 3E-07 

750 

182.4182 

1  8242E-07 

0.39 

4.67739E-07 

2.6881 6E-07 

760 

184.8485 

1  8485E-07 

0.396 

4.66789E-07 

2.6827E-07 

770 

187.0987 

1.871E-07 

0.402 

4.6542E-07 

Z67483E-07 

780 

188.3888 

1  8839E-07 

0.407 

4.62872E-07 

2.6601 8E-07 

790 

189.679 

1  8968E-07 

0.412 

4.60386E-07 

2.6459E-07 

800 

188.9889 

1  8899E-07 

0.418 

4.52127E-07 

2.59843E-07 

810 

187.7888 

1  8779E-07 

0.423 

4.43945E-07 

2.55141  E-07 

820 

190.5491 

1  9055E-07 

0.429 

4.441 7E-07 

2.5527E-07 

830 

196.4296 

1  9643E-07 

0.435 

4.51562E-07 

2.5951 9E-07 

840 

205.4305 

2.0543E-07 

0.44 

4.66888E-07 

2.68326E-07 

850 

216.8617 

2.1686E-07 

0.445 

4.8733E-07 

2.80074E-07 

860 

230.9931 

2.3099E-07 

0.45 

5.1331 8E-07 

2.9501  E-07 

870 

246.6847 

2.4668E-07 

0.455 

5.42164E-07 

3.11589E-07 

880 

263.2763 

2.6328E-07 

0.46 

5.7234E-07 

3.28931  E-07 

890 

279.988 

2.7999E-07 

0.464 

6.03422E-07 

3.46794E-07 

900 

295.4395 

2.9544E-07 

0.472 

6.25931  E-07 

3.59731  E-07 

910 

313.5914 

3.1359E-07 

0.477 

6.57424E-07 

3.7783E-07 

920 

330.5131 

3.3051  E-07 

0.481 

6.87137E-07 

3.94907E-07 

930 

344.6745 

3.4467E-07 

0.486 

7.09207E-07 

4.0759E-07 

940 

358.6259 

3  5863E-07 

0.491 

7.30399E-07 

4.19769E-07 

950 

369.547 

3.6955E-07 

0.494 

7.48071  E-07 

4.29926E-07 

960 

379.4779 

3.7948E-07 

0.499 

7.60477E-07 

4.37056E-07 

970 

386.1986 

3.862E-07 

0.499 

7.73945E-07 

4.44796E-07 

980 

389.649 

3.8965E-07 

0.501 

7.77742E-07 

4.46978E-07 

990 

388.5688 

3.8857E-07 

0.496 

7.83405E-07 

4.50233E-07 

1000 

381.5182 

3.81 52E-07 

0.487 

7.83405E-07 

4.50233E-07 

1010 

366.7567 

3.6676E-07 

0.472 

7.77027E-07 

4.46567E-07 

1020 

343.7444 

3.4374E-07 

0.447 

7.69003E-07 

4.41956E-07 

1030 

311.0711 

3.1107E-07 

0.413 

7.53199E-07 

4.32873E-07 

1040 

269.3969 

2.694E-07 

0.369 

7.30073E-07 

4.19582E-07 

1050 

226.5227 

2.2652E-07 

0.318 

7.12335E-07 

4.09388E-07 

1060 

180.258 

1  8026E-07 

0.262 

6.88008E-07 

3.95407E-07 

1070 

147.6148 

1  4761  E-07 

0.216 

6.83402E-07 

3.9276E-07 

1080 

119.862 

1  1986E-07 

0.18 

6.659E-07 

3.82701  E-07 

1090 

96.12962 

9.613E-08 

0.149 

6.45165E-07 

3.70785E-07 

1100 

76.08761 

7  6088E-08 

0.121 

6.28823E-07 

3.61393E-07 

4>  4"  #> 


Wavelength  [nm] 


Light  Intensity  vs.  Wavelength 


Table  2.  Characterization  Values  for  the  Reference  Photodiode 
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APPENDIX  C  -  CHARACTERIZATION  MEASUREMENTS  OF  THE 

FOVEON  IMAGE  SENSOR 


Characterization  Mesurenients  of  the  FOVEON  Imaqe  Sensor 

FOVEOH 

Exposure 

Pixel  Area 

Run 

Wavelength  Range 

time  [ms] 

Amp  Sensity 

Manashrometer  Slit 

Lamp  Current 

[mm'] 

1 

450.00 

1100.00 

30. DD 

300.00 

mV 

0.30 

mm 

7.00 

A 

3.B2E-D5 

Run 

Intensity 

FOVEON  Power 

WavelenpUh  Inml 

FOVEON  Detector  Readinp 

FOVEON  Detector  Simpal  IV1 

W/mm2 

W 

FGV  FLesponsivitv  1AWI 

R 

G 

E 

F 

C- 

E 

R 

G 

B 

450 

0 

5 

20 

0 

0.0976563 

3.390025 

2.95333E-09 

2.46137E-1B 

a 

3.96SE-1 1 

1.56702E412 

460 

5 

ia 

30 

0.0970503 

0.1953125 

0.535930 

4.47345E-D9 

3.721B1E-13 

2.02332E+1 1 

5.24SE+1 1 

1.5742BEf12 

470 

5 

15 

35 

0.0970563 

0.2929633 

3.633594 

7.D2203E-D9 

5.E4237E-1B 

1.07152E+1 1 

5.D15E-1 1 

1 . 1 7DD6E-S- 1 2 

480 

10 

20 

40 

0.1953125 

0.390625 

0.78125 

"  .04663E-D8 

3.7D7BBE-13 

2.2429 1  E-i- "  1 

4.436E411 

3.B7154E-1 1 

490 

15 

30 

40 

0.2929633 

0.5359375 

Q.7B125 

1.53434E-03 

1.27657E-12 

2.29490E+1 1 

4.5*6E+11 

6.1 199E+1 1 

500 

20 

45 

50 

0.3B0625 

0.8789063 

0.970503 

2.0592E-08 

1. 71325 E-12 

2.23QQ2E+1 1 

5.13E+11 

5.70DD5Er1 1 

510 

30 

00 

60 

0.5059375 

1.171875 

1.171375 

2.66923E-0S 

2.2203E-12 

2.03341E-f- 1 

5.277E+1 1 

5.27681  E4 11 

500 

35 

65 

63 

D. 6335933 

1 .2695313 

1.23M09 

3.45536E-0S 

2  87486  E-12 

2.37734E+1 1 

4.416E+1 1 

4.23C1E4-- 

530 

45 

75 

70 

D. 3739063 

1 .4643433 

1.307133 

4.42266E-08 

3.67965  E-12 

2.33353E+1  f 

3.981E-r1  1 

3.7155BE411 

540 

60 

95 

as 

1.171875 

'  .3554633 

1.71875 

5.5461  E-G8 

4.61436E-12 

2.53903E+1 1 

4.D21E-1 1 

3.7247&Ef11 

550 

70 

105 

06 

1.3671375 

2.0507313 

1.355409 

6.67151E-08 

5.55Q7E-12 

2.403Q9E+1 1 

3.695E-1 1 

3.B4277Er1 1 

560 

95 

f2G 

05 

1.3554033 

2.34375 

1.355409 

8.DD178E-0S 

0.65748 E-12 

2.73704E+1 1 

3.52E+11 

2  7&7Z4E411 

570 

100 

t3G 

05 

1.053125 

2.5390625 

1.355409 

9.43531  E-OS 

7..B5D5BE-12 

2.43737E+1 1 

■S.234E+1 1 

2.B6B4BE-1 1 

530 

120 

130 

05 

2.34375 

2.5390625 

1.355409 

1.D3D48E-D7 

8.5730E-12 

2.73303E+1  f 

2.961E-1 1 

2.16417E+11 

590 

130 

135 

95 

2.5390625 

2.6367133 

1.355409 

1.1277E-07 

9  B6246E-12 

2.7O013E+1  f 

2.81  Ef  11 

1  .B775BE4- 1 1 

600 

130 

130 

65 

2.5390625 

2.5390625 

1.355409 

1.26D73E-D7 

1.D4BB2E-1 1 

2.42064E+1 1 

2.421E-f  1 1 

1  76EBBEr1 1 

610 

132 

125 

35 

2.57B125 

2.4414063 

1.000150 

1.4D337E-D7 

11070E-1 1 

2.2Q305E+1 1 

2.D91E411 

1.421E5E-1 1 

600 

160 

140 

05 

3.125 

2.7 14  37  5 

1.355409 

"  .55133E-D7 

1.2BD71E-1 1 

2.421 15E+1 1 

2.1 19E-1 1 

1  4B756E-11 

630 

162 

130 

00 

3.1640025 

2.5390625 

1.757013 

1 .61346E-D7 

1.3424E-1 1 

2.357Q2E+1 1 

1.B91E+1 1 

1„B0B45Er1 1 

640 

1B2 

155 

105 

3.75 

3.0273433 

2.050731 

1 .8045E-07 

1.5D1B4E-1 1 

2.49770E+1 1 

2.D16E-1 1 

1.B65B6E-1 1 

650 

IBB 

133 

IDO 

3.671B75 

2.695312 5 

1.953125 

'  .95921E-07 

1  63006E-1 1 

2.2526Ef1 1 

1 .654E-1 1 

1 .1 BB1  BE- 1 1 

660 

102 

128 

105 

3.75 

2.5 

2.050731 

2.D6562E-07 

1.7130E-1 1 

2.13201E+11 

1.455E+11 

1.1BB2BEf1 1 

670 

104 

145 

100 

3.7390625 

2.3320313 

1.953125 

2.13595E-07 

1.7771  IE-11 

2.13215E+1 1 

1 .594E-S-1 1 

1  0BB:4E-11 

630 

202 

150 

100 

3.9453125 

2.9296375 

1.953125 

2.2DD83E-D7 

1.B310BE-11 

2.15463E+1 1 

1.6E411 

1  06665E-1 1 

690 

240 

165 

110 

4.6B75 

3.2226563 

2.143433 

2.27445E-07 

1.BB234E-1 1 

2.477Q9E+1 1 

-.7D3E411 

1.13533Ef1 1 

700 

222 

143 

05 

4.3359375 

2.5506*25 

1.355409 

2.3767SE-07 

1  B774BE-11 

2.19260E+1 1 

1.462E411 

93830003383 

710 

240 

165 

105 

4.6875 

3.2226563 

2.050731 

2.490 15E-D7 

2.0713E-1 1 

2.20252E+1! 

"  .555E-1 1 

BBBB53 15745 

700 

245 

170 

105 

4.7351503 

3.3203125 

2.050731 

2.5689E4J7 

2.13732E-11 

2.23335E+1 1 

"  .553E-1 1 

95B50BB240B 

730 

250 

175 

105 

4.3323125 

3.4179633 

2.050731 

2.62873E-07 

2.1B714E-1 1 

2.23251  E+lf 

"  .563E-1 1 

93765324417 

740 

250 

165 

105 

4.3323125 

3.2226563 

2.050731 

2.67313E-D7 

2.224D4E- 1 1 

2.195i7E-T  1 

1.449E411 

922DB551DB5 

750 

250 

160 

06 

4.3323125 

3.125 

1.355409 

2.63316E-07 

2  2B655E-1 1 

2.13319E+1 1 

1 .397E-1 1 

B2B61B6ED26 

760 

250 

160 

106 

4.3323125 

3.125 

1.953125 

2.6S27E-G7 

2.232E-11 

2.13704E+1 1 

1.4E411 

E75054B2B75 

770 

250 

140 

30 

4.3323125 

2.724275 

1.5025 

2.674S3E-07 

2.22545E- 1 1 

2.1 9^-07  E-f"  1 

"  .229E-1 1 

76210361681 

730 

250 

130 

30 

4.3323125 

2.5390625 

1.5025 

2.66D13E-07 

2.21327E-11 

2.2O015E+1  f 

1.147E411 

705B6E275B6 

790 

250 

130 

75 

4.3323125 

2.5390625 

1.404344 

2.6459E-G7 

2_2D1 3BE- 1 1 

2.213Q0E+1 1 

1.153E-1 1 

66541909265 

SOD 

250 

128 

TO 

4.3323125 

2.5 

1.307133 

2.59S43E-07 

2.161  BBE-11 

2.25353E+11 

1.156E-11 

6324D312DDB 

310 

245 

125 

65 

4.7351563 

2.4414063 

1.269531 

2.55141E-07 

2.12277E-11 

2.2542Ef  1 1 

1.15E+11 

5BB05B5B357 

SOD 

245 

125 

65- 

4.7351503 

2.4414063 

1.209531 

2.5527E-07 

2.123B5E-11 

2.253Q0E+1 1 

1.15E+11 

5B7750B0446 

330 

240 

120 

64 

4.6B75 

2.34375 

1.25 

2.59519E-07 

2.15B1BE-11 

2.17095E+1 1 

1.DS5E411 

57BB1B4E464 

340 

105 

90 

60 

3.3035933 

-.7573125 

1.171275 

2.68326E-D7 

2.23247E-11 

1.7O0E+1 1 

7.S74E410 

524B2212213 

850 

105 

90 

60 

B. 3035933 

-.7573125 

1.171275 

2.SDD74E-D7 

2.33D22E-1 1 

1.03444E+1 1 

7.544E-10 

502B0B2DB61 

360 

200 

95 

60 

3.90625 

1 .3554633 

1.171375 

2.S5G1E-G7 

2  4544BE-1 1 

1.59147E+T1 

7.559E410 

47744210065 

370 

220 

95 

60 

4.2B6B75 

1 .3554633 

1.171275 

3.1 1589E-D7 

2.5B242E-1 1 

1.05743E+1 1 

7.157E-10 

4520BB577BB 

330 

200 

90 

55 

B.90625 

-.7573125 

1.074219 

3.2S931E-07 

2.73671  E- 11 

1.42735E+1 1 

5.423E-10 

39252258951 

390 

220 

95 

60 

4.2B6B75 

1 .3554633 

1.171075 

3.46794E-07 

2.BB533E-11 

1.43921E+11 

6.431E410 

4D614B35023 

900 

215 

95 

60 

4.1992133 

1 .3554633 

1.171275 

3.59731E-07 

2.BB2B6E-1 1 

1.40303E+1 1 

6.199E410 

3B1544DDBB1 

910 

100 

90 

55 

3.7109375 

1.7573125 

1.074219 

3.77S3E-07 

3.14B55E-1 1 

113049E+11 

5.592E-1Q 

341721BB025 

900 

102 

90 

55 

3.75 

1.7573125 

1.074219 

3.949D7E-07 

3.2E562E-11 

1.14134E+1 1 

5.25E+1D 

326B45B0052 

930 

175 

70 

45 

3.4179633 

1.3671875 

0.373900 

4.0759E-Q7 

3.3B115E-11 

1.QQ791E4"  1 

4.D32E-10 

25B176504B6 

940 

170 

65 

40 

3.3203125 

1.2695313 

0.78125 

4.19769E-D7 

3.4B24BE- 1 1 

95070231331 

8.635E410 

2236B477B60 

950 

170 

04 

40 

3.3203125 

1.25 

0.78125 

4.29B26E-D7 

3.576BBE-1 1 

92324403205 

].495E-10 

21841037225 

960 

16B 

04 

40 

3.23125 

1.25 

0.78125 

4.37056E-D7 

3.0303E-1 1 

90235380 1 19 

S.43SE410 

21484733362 

970 

160 

04 

40 

3.3007313 

1.25 

0.78125 

4.44796E-D7 

3.70a7E-1 1 

39193356434 

8.37SE410 

21110853594 

930 

135 

02 

35 

2.6307133 

-.2109375 

0.033594 

4.4697SE-D7 

3.71&E6E-11 

70901257590 

■B.256E410 

18381B07523 

990 

123 

00 

32 

2.5 

1.171875 

0.625 

4.50233E-D7 

3  745B4E-11 

66733989005 

3.128E-1Q 

166B4747401 

1CGG 

103 

50 

30 

2.109375 

0.9765625 

0.535933 

4.50233E-07 

3.745B4E-1 1 

56311029207 

2.6D7E410 

" 5641B5255B 

1010 

103 

45 

23 

2.0117133 

0.3789063 

0.540375 

4.46567E-D7 

3.71544 E-11 

54144349152 

2.366E410 

1471BBBB11B 

1020 

25 

40 

25 

1.6001503 

0.73125 

0.433231 

4.41956E-07 

3.677D7E-11 

45143360347 

2.125E-10 

1  327B076720 

1030 

75 

33 

25 

1.4643433 

0.7421375 

0.433231 

4.32S73E-D7 

3.0Q15E-1 1 

40673130743 

2.D61E410 

1355771 D24B 

1040 

05 

35 

20 

1.2395313 

0.6335933 

0.390025 

4.19582E-07 

3.4BDB2E-1 1 

36366627003 

1.95SE410 

f 11BB7313B6 

1050 

50 

30 

13 

0.9705025 

0.5359375 

0.351503 

4.D93S3E-D7 

3.4061  IE-11 

23670907162 

1.72E+1D 

10321526578 

1050 

43 

25 

15 

Q.B375 

0.4SS2S13 

0.292909 

3.954D7E-07 

3.2BB7BE-11 

23497310796 

1.4S4E410 

3905409624 

1070 

45 

20 

10 

0.3739003 

0.3506*25 

0.195313 

3.9276E-07 

3_26776E-11 

26396293634 

1.195E+10 

597095^152 

TOEO 

40 

15 

10 

6.73125 

0.2929633 

0.195313 

3.S27D1E-07 

3.184D7E-1 1 

24536132622 

9.2D1Et09 

0134045055 

fOSO 

40 

10 

10 

0.73125 

0.1953125 

0.195313 

3.7D7S5E-D7 

3.DB4B3E-11 

25324741043 

6.331E409 

0331135202 

HOG 

35 

5 

5 

0.6335933 

0.0976563 

0.097650 

3.61393E-D7 

3.DD67BE- 1 1 

22735025433 

3.24SE409 

3247300777 

Table  3.  Characterization  values  for  the  FOVEON  Sensor 
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FOVEON  Detector  Signals  vs.  Wavelength 


Red  Det  Signal 
-■-Green  Det  Signal 
Blue  Det  Signal 


Wavelength  [inn] 


Figure  26.  FOVEON  Sensor  Signals  vs.  wavelength  [above],  FOVEON  Sensor 

Responsivity  vs.  wavelength  [below] 
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APPENDIX  D  -  FRAMELINK  FRAME-GRABBER  FOVEON 

SPECIFICATION 


[Camera] 

SrcX=0 

Filter=0 

InvertDV=0 

Manufacturer=Han  Vision 

SrcY=0 

PLLMode=0x0 

InvertLV=0 

Model=HVDUO 

Fast=0 

MDivisor=0 

InvertFV=0 

Description=Foveon  Camera 

HBlankStart=0 

NDivisor=0 

Switches^ 

HBlankEnd=0 

LinesPerFrame=0 

Setup= 

VBlankStart=0 

BitDepth=24 

[Video] 

VBlankEnd=0 

LineScan=0 

Version=0 

PLLCloekDivisor=0 

CameraCtrl=0 

RGB=2 

ClampLevel=0 

ReverseTap=0 

XRes=1422 

TriggerDirection=OxO 

TapOrder=l 

YRes=1068 

Outputs=OxO 

P  ALF  ieldOrder=0 

AsyneTrigger=0 

lris=0 

BayerMode=l 

FtSyncSource=0 

N  onInterlaced=  1 

BaudRate=9600 

HSynePolarity=0 

LteWait=0 

IgnoreDV=0 

ADClockSource=0 

LteTime=0 

RedGain=0 

VSyncSource=0 

LteMaster=0 

GreenGain=0 

VSynePolarity=0 

LteFrames=0 

BlueGain=0 

Table  4.  The 

Frame-Grabber  Specification  for  the  FOVEON  Camera 
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APPENDIX  E  -  IDL  PROGRAM  TO  DETECT  NON-VEGETATION 


{Note  comment  lines  are  in  green  with  in  front,  all  other  lines  are  code} 

;  An  IDL®  program  to  extract  NIR  information  from  a  FOVEON  image  and 
calculates 

;  NDVI  and  display  areas  in  the  image  that  are  most  probable  non-vegetation. 
;Define  input  and  output  directories' 
dir  =  'S:\Foveon\outside\tesf 
output_dir  =  dir+'\Output_Files' 

CD,  dir 

;Routine  to  find  and  load  image  files  from  the  input  directory.  Activate  either  this 
;routine  of  user  select  routine  below 

;file  =  FILE_SEARCH('*.tif)  {note  need  to  remove  to  activate  line} 

;image  =  READ  TIFF(file)  {note  need  to  remove  to  activate  line} 

;Routine  to  have  user  select  the  input  image  file 

file  =  dialog_pickfile()  {note  need  to  add  to  de-activate  line} 

image  =  read_tiff(file)  {note  need  to  add  to  de-activate  line} 

;Size  and  display  input  image 
image  =  image}*, *,0:1058) 
nx  = 1422 
ny  = 1058 

WINDOW,  2,  TITLE- Input  Image',  xsize  =  nx/3,  ysize  =  ny/3 
im  =  CONGRID}  image,  3,  nx/3,  ny/3) 

TV,  im,  true  =  1,  order  =  1 

;Create  array  for  each  color  band  (R,G,B) 

data  =  float}  image) 

red  =  data(0,  *,  *) 

green  =  data(l,  *,  *) 

blue  =  data(2,  *,  *) 

;Create  NIR  image  and  display  it 
nir  =  red  -  green 

window,  0,  TITLE- NIR  Image',  xsize  =  nx/3,  ysize  =  ny/3 

imnir  =  bytscl(nir) 

iml  =  congrid}  im_nir,  1,  nx/3,  ny/3) 

tv,  iml,  order  =  1 

;Calculate  and  display  NDVI 
ndvi  =  (nir  -  red)  /  (nir  +  red) 

window,  3,  TITLE-NDVI',  xsize  =  nx/3,  ysize  =  ny/3 
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im_ndvi  =  bytscl(ndvi,  min=- 1 ,  max=l) 
im2  =  congrid(  im_ndvi,  1,  nx/3,  ny/3) 
tv,  im2,  order  =  1 

;Calculate  and  display  probable  non-vegetation 
non_veg  =  im_ndvi  LT  median(im_ndvi) 

;non_veg  =  ndvi  LT  1 

window,  1,  TITLE-Probable  Non- Vegetation' ,xsize  =  nx/3,  ysize  =  ny/3 
im_non_veg  =  bytscl(non_veg,  min=0,  max=l) 
im3  =  congrid(  im_non_veg,  1,  nx/3,  ny/3) 
tv,  im3,  order  =  1 

;Output  image  files 
cd,  output_dir 

write_tiff, 'input.tif  ,reform(image) 
write_tiff,'NIR.tif,  reform(iml) 
write  tiff, 'NDVI.tif,  reform(im2) 
write_tiff, 'Non_veg.tif,  reform(im3) 

end 
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APPENDIX  F  -  FILTER  CURVE  FOR  THE  IR  TRANSMIT  FILTER 


Below  is  the  transmittance  curve  of  the  infrared  transmits  filter  use  to  verify  that 
the  pseudo  NIR  calculated  from  the  subtracting  the  green  band  from  the  red  band  was 
comparable  to  real  NIR. 
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Figure  27.  R-70  Infrared  Transmitting  Filter  Curve 
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